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SUMMARY  AND  HIGHLIGHTS 


This  report  presents  the  results  of  an  analysis  of  the  manner  in 
which  information  is  utilized  from  the  Promotion  Roster  Information  Sheet 
to  ascertain  promotability  from  Forester  (series  460)  GS-12  to  GS-13. 

The  major  categories  of  information  on  this  form  are  of  two  types, 
those  referring  to  the  individual  s characteristics  and  those  referring 
to  his  qualifications . An  explicit  weighting  system  is  used  to  combine 
characteristics  and  qualifications  scores  into  an  index  of  promotability o 

It  was  found  that  out  of  eleven  characteristics  categories  there  is 
little  or  no  gain  in  information  after  the  six  most  informative  categories 
have  been  considered  (summarized  in  Exhibit  5,  page  10) 0 Similarly,  out 
of  fifteen  qualifications  categories,  eight  yielded  most  of  the  differen- 
tial information  (summarized  in  Exhibit  10,  page  15)  ."best^S  However, 
these  categories  of  characteristics  and  of  qualifications  differed  for 
different  program  specialties . The  total  characteristics  and  total 
qualifications  scores  were  found  to  combine  in  accordance  with  the 
officially  prescribed  weighting  system  (in  a ratio  of  about  105  or 
2.0  to  1). 

The  development  of  a means  for  supervisory  documentation  of  effective 
and  ineffective  behaviors  was  recommended  as  an  approach  for  the  improve- 
ment of  current  appraisal  procedures. 
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PROMOTION  TO  GS-13  FORESTER:  SOME  EMPIRICAL 
ANALYSES  OF  THE  DECISION-MAKING  PROCESS 


Introduction 

Career  planning  involves  systematic  progression  through  various  alter- 
native position  pathways.  Thus,  in  the  Forest  Service,  various  lines  of 
advancement  are  depicted  through  which  an  individual  can  move  within  the 
Forester  series  (see  "Organization  and  Management  in  the  Forest  Service," 
USDA,  February,  1962,  p.  59).  This  career  network  has  many  choice  points, 
from  the  standpoint  both  of  the  individual  and  of  the  organization. 

Examples  of  the  organization's  choice  points  are  the  selection  and  pro- 
motion of  a Forester  to  a Ranger,  or  a Ranger  to  a Forest  Supervisor. 
Willingness  to  be  considered  as  a candidate  for  promotion  to  a particular 
position  is  an  example  of  an  individual's  choice.  Thus,  an  individual  may 
prefer  to  remain  in  a given  locale  for  some  period  of  time,  and  may  there- 
fore withdraw  from  consideration  during  that  period. 

At  each  of  these  choice  points  there  are  certain  policies  affecting 
the  evaluation  of  an  individual's  qualifications.  These  policies  may  be 
explicit  and  even  formally  stated,  or  they  may  be  implicit  and  informal. 
Where  the  evaluation  and  selection  of  large  numbers  of  candidates  is 
involved  these  policies  are  usually  explicit,  but  where  the  numbers  are 
small  the  policies  are  less  likely  to  be  explicit. 

Whether  policies  are  explicit  or  implicit,  operationally  they  are 
manifested  in  selection  decisions  which  must  be  made  in  order  to  meet  the 
needs  of  an  ongoing  career  system.  At  each  choice  point  at  least  two  kinds 
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of  organization  decisions  can  be  made.  These  are: 

1.  An  appraisal  of  the  candidate's  qualifications  and  determination 
of  his  degree  of  acceptability  for  the  position. 

2.  Selection  of  one  or  more  candidates  to  fill  the  opening(s) . 

Oftentimes  the  first  step  is  conducted  before  the  openings  actually 

occur,  and  then  when  an  opening  occurs  one  or  more  individuals  are 
selected  from  the  pool  of  qualified  people. 

Reported  here  is  an  analysis  of  the  decision  process  presently 
involved  in  appraising  candidates  for  promotion  from  GS-12  to  GS-13  in 
the  Forester  (460)  series.  It  focuses  on  the  first  kind  of  selection 
decision. 

The  information  used  in  this  analysis  was  taken  from  the  Forest 
Service's  Promotion  Roster  (Form  6100-10(1/60)).  A specimen  of  this  form 
is  given  in  the  Forest  Service  Employee  Appraisal  Guide  (Forest  Service 
Category  2 Handbook,  6166.01,  page  8). 

Two  major  kinds  of  information  are  documented  on  this  form  by  a 
candidate's  supervisor.  These  pertain  to  the  candidate's  characteristics 
(e.g.  drive,  self-confidence,  objectiveness,  etc.)  and  qualifications 
(e.g.  managerial  skills,  growth  potential,  work  experience,  etc.).  The 
supervisor  then  inspects  the  various  characteristic  scores  and  arrives 
at  an  overall  characteristics  rating.  In  a similar  manner,  he  obtains 
an  overall  qualifications  rating.  These  ratings  are  then  weighted  and 
summed  to  arrive  at  a readiness  for  promotion  rating  (see  the  Employee 
Appraisal  Guide,  page  26,  for  this  weighting  system). 
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An  individual  may  receive  a rating  in  one  or  more  of  the  following 
areas:  (1)  Timber  Management;  (2)  Watershed  Management;  (3)  Land  Uses 

(Recreation);  (4)  Land  Uses  (Other);  (5)  Wildlife  Management;  (6)  Range 
Management;  (7)  Fire  Control;  (8)  Administration  and;  (9)  General.  (The 
ninth  category  was  not  analyzed  due  to  the  small  numbers  of  people 
involved . ) 

The  utilization  of  multiple  regression  analysis  requires  that  the 
various  categories  of  information  be  quantified  by  assigning  numbers  to 
the  kinds  of  information  represented  in  each  category.  Many  categories 
are  already  quantified  as  they  appear  on  this  form.  For  others  a scheme 
of  coding  had  to  be  devised.  A description  of  the  coding  for  character- 
istics, qualifications,  and  overall  promotability  is  presented  in 
Appendix  A. 

An  explanation  of  the  manner  in  which  multiple  regression  analysis 
attempts  to  utilize  such  information  will  be  given  first.  Then  the 
questions  one  seeks  to  answer  by  applying  this  technique  to  information 
taken  from  the  promotion  roster  will  be  described.  Results  and  discus- 
sion of  these  analyses  will  follow. 

The  Utilization  of  Information  in  Multiple  Regression  Analys is 

The  manner  in  which  this  mathematical  technique  utilizes  information 
is  best  illustrated  by  a few  simple  diagrams. 

Suppose  that  we  have  two  categories  of  information  that  are  of 
interest  to  us.  These  can  be  represented  by  means  of  two  overlapping 
circles  or  sets  labeled  A and  B.  The  area  of  overlap,  the  shaded  area, 
represents  that  information  which  is  common  to  both  A and  B. 
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Suppose  we  wanted  to  add  up  everything  in  A and  B by  adding  first 
everything  in  A and  then  everything  in  B.  In  doing  this  we  would  have 
counted  everything  in  the  shaded  area  twice,  once  when  counting  A and 
once  when  counting  B.  In  order  to  be  correct  in  our  arithmetic  we  only 
want  to  count  the  shaded  area  once,  hence  we  would  subtract  it  once 
(A  + B = A + B - <©). 

Now  let  us  complicate  the  picture  a little  by  introducing  a third 
set  C, 


and  let  us  define  the  following  areas: 

® - that  information  in  the  intersection  of  all  three  sets; 

- that  information  common  to  B and  C which  A does  not  have; 

that  information  common  to  A and  C which  B does  not  have; 

;I\  - that  information  common  to  A and  B which  C does  not  have. 

If  we  wanted  to  add  up  everything  in  all  three  sets,  A + B + C, 
we  would  end  up  counting  the  dotted  and  slanted  areas  twice  each  and  the 
solid  area  three  times.  To  correct  for  this  we  would  subtract  the  dotted 
and  slanted  areas  once  each  and  the  solid  area  twice,  i.e. 

A+B  + C-  Q-  ^-  ©-  2 @ . 
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We  could  make  the  picture  increasingly  complex  by  adding  more  sets 
of  information,  however,  this  example  is  sufficient.  Let  us  ascribe  some 
meaning  to  these  categories  of  information. 

Let  us  now  assume  that  A,  and  C are  three  measures  on  a group  of 
people: 

A - Score  for  each  person  representing  his  qualifications; 

B - Score  for  each  person  representing  his  characteristics; 

C - Index  designating  each  person's  promotability . 

In  this  context  multiple  regression  analysis  would  attempt  to  ascer- 
tain the  manner  in  which  categories  A and  B are  combined  to  arrive  at  an 
individual's  promotability  index.  The  outcome  would  be  a set  of  weights 
assigned  to  each  category  of  information  so  that  when  combined  they  pro- 
vide the  promotability  index.  The  weights  are  assigned  to  these  cate- 
gories so  as  to  maximize  their  relationship  with  the  promotability  index 
and  minimize  the  amount  of  overlap  between  categories  A and  B.  Thus,  in 
the  following  example: 


The  solid  area  would  be  counted  as  part  of  A and  then  in  assigning 
a weight  to  B the  solid  area  would  not  be  counted  again.  Thus,  B would 
play  a much  smaller  part  in  determining  C than  would  A. 

An  individual's  A score  would  then  be  multiplied  by  the  weight  for 
A,  his  B score  by  the  weight  for  B,  and  then  these  two  weighted  scores 
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would  be  summed  in  order  to  arrive  at  an  estimated  C score.  A measure  of 
the  adequacy  with  which  the  C scores  are  estimated  by  this  weighting 
system  is  called  the  multiple  correlation.  This  value  varies  from  1.00 
for  perfect  estimation  to  .00  for  lack  of  any  relationship. 

The  kinds  of  questions  one  wants  to  answer  from  an  analysis  of  this 
nature  are: 

1.  Are  there  a few  critical  categories  of  information  that  contri- 
bute to  the  promotability  index? 

2.  Do  promotion  policies  need  to  be  made  more  explicit  and  admin- 
istered more  consistently? 

3.  Do  the  present  practices,  as  they  are  empirically  manifested  by 
the  analysis  of  the  current  decision-making  process,  result  in  the  selec- 
tion of  individuals  who  perform  well  in  the  positions  to  which  they  are 
promoted? 

Results  and  Discussion 

The  full  results  of  the  analyses  are  presented  for  each  of  the  eight 
work  areas  in  Appendix  B.  A graphic  display  is  given  of  the  contribution 
of  each  category  to  the  total  score.  A discussion  of  these  graphs  is 
organized  around  the  kinds  of  questions  this  analysis  seeks  to  answer. 

An  answer  to  question  3 is  taken  up  in  the  section  on  recommendations 
and  conclusions.  Characteristics  and  qualifications  analyses  were  con- 
ducted for  the  following  areas:  Timber  Management;  Lands  (Other)  Manage- 
ment; Fire  Control  and;  Administration.  Analyses  were  not  conducted  on 
the  other  areas  due  to  the  small  numbers  of  people  involved. 
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Characteristics  Analysis 

(1)  Are  there  a few  critical  characteristic  categories  that  contribute 
to  the  total  characteristics  score? 

The  characteristic  categories  included  in  this  analysis  are: 


1. 

Drive 

7. 

Versatility 

2. 

Self-Confidence 

8. 

Originality 

3. 

Objectiveness 

9. 

Open-Mindedness 

4. 

Respons iveness 

10. 

Sociability 

5. 

6. 

Initiat ive 

Persistence 

11. 

Service  Concept 

Exhibits  1 through  4 present  graphic  illustrations  of  the  additional 
amount  of  information  that  each  of  these  categories  contribute  to  the 
total  characteristics  score.  Thus,  Exhibit  1 shows  that  20  percent  of  the 
total  characteristics  score  can  be  accounted  for  by  the  information  in 
Category  6 (Persistence);  28  percent  can  be  accounted  for  by  Categories  6 
and  8 (Originality);  38  percent  by  Categories  6,  8 and  10  (Sociability); 
and  so  on . 

Inspection  of  all  of  these  graphs  shows  that  there  is  little  or  no 
gain  in  information  after  the  six  best  (or  most  informative)  categories 
have  been  considered.  However,  these  are  not  the  same  six  categories  for 
all  areas  of  work.  The  six  best  categories,  for  each  area  of  work,  are 
given  in  Exhibit  5. 

In  summary  one  can  see  that:  (10)  Sociability  is  pertinent  to  all 
of  the  areas  of  work;  (2)  Self-Confidence,  (6)  Persistence  and  (9)  Open- 
Mindedness  are  considered  in  three  areas  of  work;  (4)  Responsiveness, 

(7)  Versatility  and  (8)  Originality  are  informative  for  two  areas  of 
work  while  other  characteristics  such  as  (3)  Objectiveness,  (5)  Initia- 
tive and  (11)  Service  Concept  are  unique  to  a particular  work  area. 


PERCENT  OF  COMMON  VARIATION  PERCENT  OF  COMMON  VARIATION 


EXHIBIT  1 s 

TIMBER  MANAGEMENT 

Gain  in  Information  by  Increasing  the  Number  of  Categories 

100" 

90-- 

80- 

70- 

60- 


6 8 10  5 9 2 7 11  1 3 4 

CHARACTERISTIC  CATEGORY  ADDED 

MULTIPLE  CORRELATION  .71.  NUMBER  OF  CANDIDATES  24 5.  *THE  SQUARED  MULTIPLE  CORRELATION. 

EXHIBIT  2 

LANDS  (OTHER)  MANAGEMENT 

Gain  in  Information  by  Increasing  the  Number  of  Categories 

100” 

90- 

80- 

70- 

60- 


4 7 6 11  3 10  8 1 9 2 5 

CHARACTERISTIC  CATEGORY  ADDED 

MULTIPLE  CORRELATION  .69.  NUMBER  OF  CANDIDATES  126.  *THE  SQUARED  MULTIPLE  CORRELATION. 
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PERCENT  OF  COMMON  VARIATION*  PERCENT  OF  COMMON  VARIATION 
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EXHIBIT  3 

FIRE  CONTROL 

Gain  in  Information  by  Increasing  the  Number  of  Categories 
00t  ray 

90- 

80- 

70 

60 

50 

40 

30 

20 

10 

0 

6 2 9 1 Z 10  5 4 8 3 11 

CHARACTERISTIC  CATEGORY  ADDED 

MULTIPLE  CORRELATION  .67.  NUMBER  OF  CANDIDATES  169.  *THE  SQUARED  MULTIPLE  CORRELATION. 


EXHIBIT  4 

ADMINISTRATION 

Gain  in  Information  by  Increasing  the  Number  of  Categories 

100  T 
90- 
80- 
70- 


■ 
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Exhibit  5 


Rank  Order  Contribution  of  Each  Characteristic 
to  Total  Characteristics  Score 


Characteristic 

Work  Area 

Timber 

Lands 

(Other) 

Fire 

Control 

Adminis- 

tration 

1. 

Drive 

4 

5 

2. 

Self-Confidence 

6 

2 

2 

3. 

Objectiveness 

5 

4. 

Responsiveness 

1 

1 

5. 

Initiative 

4 

6. 

Persistence 

1 

3 

1 

7. 

Versatility 

2 

5 

8. 

Originality 

2 

4 

9. 

Open-Mindedness 

5 

3 

6 

10. 

Sociability 

3 

6 

6 

3 

11.  Service  Concept 


4 
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(2)  Do  policies  for  evaluating  characteristics  need  to  be  made  more 
explicit  and  administered  more  consistently? 

When  the  multiple  correlation  is  high  it  indicates  considerable 
agreement  among  supervisors  in  the  categories  of  information  they  utilize 
in  arriving  at  a total  characteristics  score.  When  the  multiple  correla- 
tion is  low  it  indicates  that  supervisors  do  not  utilize  the  same  cate- 
gories of  information.  The  multiple  correlations  for  characteristics 
(see  the  lower  left  hand  corner  of  each  graph)  range  from  .65  to  .71 
indicating  that  improvement  could  be  made  in  the  manner  in  which  these 
categories  of  information  are  utilized  to  arrive  at  a total  characteristic 
score.  A recommendation  as  to  how  greater  consistency  can  be  achieved  is 
taken  up  in  the  section  on  recommendations  and  conclusions. 


Qualifications  Analysis 

(1)  Are  there  a few  critical  qualifications  categories  that  contri- 
bute to  the  total  qualifications  score? 

The  qualifications  categories  included  in  this  analysis  are: 

1.  Number  of  Children 

2.  Availability  for  Transfer 

3.  Need  for  a Transfer 

4.  Growth  Potential 

5.  Remarks  Favorable  to  Promotion 

6.  Date  of  Entry  in  Present  Grade 

7.  Date  of  Entry  in  Present  Assignment 

8.  Date  of  Birth 

9.  Many  Specialties 

10.  Managerial  Skills 

11.  Professional  Interest 

12.  English  Composition 

13.  Preference  for  this  Specialty 

14.  Years  of  Experience  in  this  Specialty 

15.  Number  of  Different  Regions  Worked  in  this  Specialty 


12 


Exhibits  6 through  9 present  a graphic  illustration  of  the  additional 
amount  of  information  that  each  of  these  categories  contributes  to  the 
total  qualifications  score.  Thus,  Exhibit  5 shows  that:  17  percent  of 
the  total  qualifications  score  can  be  accounted  for  by  the  information  in 
Category  13  (Preference  for  the  Specialty);  19  percent  by  Categories  13 
and  14  (Years  Experience  in  the  Specialty);  28  percent  by  Categories  13, 

14  and  10  (Managerial  Skills);  and  so  forth0 

Inspection  of  all  of  the  graphs  shows  that  there  is  little  or  no 
gain  in  information  after  the  eight  best  (or  most  informative)  categories 
have  been  considered.  The  eight  best  categories,  for  each  area  of  work, 
are  given  in  Exhibit  10. 

One  should  note  that  although  some  of  these  categories  contribute 
to  the  total  qualifications  decision  they  may  do  so  implicitly  rather 
than  explicitly.  Thus,  size  of  family,  age,  or  availability  for  trans- 
fer may  be  related  to  other  attributes  of  the  candidate  and  it  may  be 
those  attributes  that  are  entering  the  qualifications  evaluation 

Inspection  of  Exhibit  10  shows  that  the  following  three  categories 
enter  into  the  total  qualifications  score  for  all  the  work  areas  con- 
sidered: (6)  Date  of  Entry  in  Present  Grade;  (12)  English  Composition 

and;  (13)  Preference  for  that  Specialty.  Categories  (8)  Date  of  Birth 
and  (11)  Professional  Interest  contribute  to  three  areas  of  work  whereas 
(2)  Availability  for  Transfer,  (4)  Growth  Potential,  (9)  Many  Specialties, 
(10)  Managerial  Skills  and  (14)  Years  Experience  in  the  Specialty  each 
contribute  to  two  work  areas.  Those  categories  that  contribute  to  a 


PERCENT  OF  COMMON  VARIATION*  PERCENT  OF  COMMON  VARIATION 


EXHIBIT  6 13 

TIMBER  MANAGEMENT 


QUALIFICATION  CATEGORY  ADDED 

MULTIPLE  CORRELATION  .60.  NUMBER  OF  CANDIDATES  248.  * THE  SQUARED  MULTIPLE  CORRELATION. 

EXHIBIT  7 


LANDS  (OTHER)  MANAGEMENT 

Gain  in  Information  by  Increasing  the  Number  of  Categories 


QUALIFICATION  CATEGORY  ADDED 

MULTIPLE  CORRELATION  .60.  NUMBER  OF  CANDIDATES  1 31.  *THE  SQUARED  MULTIPLE  CORRELATION. 


PERCENT  OF  COMMON  VARIATION*  PERCENT  OF  COMMON  VARIATION 


EXHIBIT  8 
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FIRE  CONTROL 


QUALIFICATION  CATEGORY  ADDED 

MULTIPLE  CORRELATION  .48.  NUMBER  OF  CANDIDATES  166.  *THE  SQUARED  MULTIPLE  CORRELATION. 

EXHIBIT  9 

ADMINISTRATION 


QUALIFICATION  CATEGORY  ADDED 

MULTIPLE  CORRELATION  .4S.  NUMBER  OF  CANDIDATES  2 79.  *THE  SQUARED  MULTIPLE  CORRELATION. 
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Exhibit  10 

Rank  Order  Contribution  of  Each  Qualification 
to  Total  Qualifications  Score 


Work 

Area 

Timber 

Lands 

(Other) 

Fire 

Control 

Adminis - 
trat ion 

No.  of  Children 

2 

Avail,  for  Transfer 

7 

6 

Need  for  Transfer 

Growth  Potential 

4 

7 

Remarks 

7 

EOD  Present  Grade 

6 

3 

6 

8 

EOD  Present  Assignment 

7 

Date  of  Birth 

8 

2 

8 

No.  of  Specialties 

5 

5 

Managerial  Skills 

3 

1 

Professional  Interest 

8 

3 

5 

English  Composition 

4 

1 

2 

4 

Preference  for  Specialty 

1 

5 

1 

3 

No.  of  Yrs.  Exp.  in  Spec. 

2 

4 

Breadth  of  Exp.  in  Spec. 

6 

' 


- 

' 

* :■  ' ■■ 
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single  work  area  are:  (1)  Number  of  Children;  (5)  Remarks  Favorable  to 
Promotion;  (7)  Date  of  Entry  in  Present  Assignment  and;  (15)  Number  of 
Different  Regions  Worked  in  this  Specialty.  Category  (3)  Need  for  a 
Transfer,  is  the  only  category  that  does  not  contribute  to  a qualifica- 
tions score  for  any  of  the  work  areas. 

(2)  Do  policies  for  evaluating  qualifications  need  to  be  made  more 
explicit  and  administered  more  consistently? 

The  multiple  correlations  for  qualifications  range  from  .45  to  .60. 
This  indicates  that  there  is  considerably  less  agreement  among  supervi- 
sors in  evaluating  qualifications  than  in  evaluating  characteristics. 

It  further  indicates  that  there  is  considerable  room  for  improvement  in 
the  consistency  with  which  supervisors  utilize  information  from  the 
qualifications  categories  to  arrive  at  a total  qualifications  score.  A 
recommendation  as  to  how  greater  consistency  .can  be  achieved  is  discussed 
in  a later  section  dealing  with  recommendations  and  conclusions. 

Promotability  Analysis 

Analysis  of  the  manner  in  which  the  total  characteristics  and  total 
qualifications  scores  contribute  to  the  index  of  promotability  were  con- 
ducted for  all  eight  areas  of  work. 

(1)  How  do  the  total  characteristics  and  total  qualifications  scores 
contribute  to  the  index  of  promotability? 

The  categories  are  numbered  as  follows: 

1.  Total  Characteristics 


2.  Total  Qualifications 
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A graphic  illustration  of  the  additional  amount  of  information  that 
each  of  these  categories  contributes  to  the  index  of  promotability  is 
given  in  Exhibit  11.  Inspection  of  the  weights  in  Appendix  B,  Exhibit  36, 
shows  that  total  characteristics  contribute  one  and  one-half  to  two  times 
as  much  as  total  qualifications  to  the  index  of  promotability.  This  is 
in  accord  with  the  explicit  weighting  system  advocated  on  page  26  of  the 
Employee  Appraisal  Guide  which  gives  more  weight  to  total  characteristics 
than  to  total  qualifications  in  determining  the  promotability  index. 

(2)  Do  policies  for  evaluating  total  characteristics  and  total 
qualifications  need  to  be  made  more  explicit  and  administered  more  con- 
sistent ly? 

The  multiple  correlations,  for  each  of  the  work  areas  in  Exhibit  11, 
range  from  .92  to  1.00.  This  means  that  the  total  promotability  index 
is  almost  perfectly  predictable  from  the  weighted  combination  of  the 
total  characteristics  and  total  qualifications  scores.  The  high  value  of 
these  multiple  correlations  is  a manifestation  of  the  explicit  weighting 
system  used.  If  an  explicit  weighting  system  were  not  used  it  is  anti- 
cipated that  the  multiple  correlations  would  be  much  lower,  probably  of 
a magnitude  comparable  to  those  for  the  characteristics  and  qualifica- 
tions analyses.  The  explicit  weighting  system  thus  contributes  to  the 
consistency  with  which  total  characteristics  and  qualifications  are 
evaluated . 

Recommendat ions  and  Conclusions 

It  was  found  that  for  characteristics,  six  out  of  eleven  categories 
yielded  most  of  the  differential  information  but  that  these  categories 


PROMOTABILITY  INDEX 

Gain  in  Information  by  Increasing  the  Number  of  Categories 

AREAS  OF  WORK 

Timber  Lands  (other)  Lands  (rec.)  Range  Watershed  Wildlife 

Management  Management  Fire  Control  Administration  Management  Management  Management  Management 
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differed  for  the  different  areas  of  work.  Similarly,  eight  out  of 
fifteen  qualifications  categories  yielded  most  of  the  differential  infor- 
mation but  as  with  characteristics,  the  categories  differed  for  the 
different  areas  of  work.  The  total  characteristics  and  total  qualifica- 
tions scores  were  found  to  combine  in  a manner  in  accordance  with  the 
prescribed  weighting  system. 

The  analysis  showed  that  there  were  some  inconsistencies  in  the 
manner  in  which  supervisors  arrived  at  the  total  character is t ics  and  the 
total  qualifications  scores  but  that  there  was  almost  perfect  consistency 
in  arriving  at  a promotability  index  from  these  latter  scores.  It  is 
notable  in  this  latter  instance  that  an  explicit  weighting  system  was 
prescribed . 

In  light  of  the  foregoing,  the  third  question  can  be  posed: 

(3)  Do  the  present  practices,  as  they  are  manifested  by  the  analysis 
of  the  current  decision-making  process,  result  in  the  selection  of  indi- 
viduals who  perform  well  in  the  positions  to  which  they  are  promoted? 

This  question  can  be  answered  on  either  a judgmental  or  an  empirical 
basis.  In  the  judgmental  case  management  can  state  their  degree  of  satis- 
faction with  the  performance  of  persons  currently  being  promoted. 

In  the  empirical  case,  the  different  categories  of  information 
would  be  evaluated  against  the  individual's  actual  performance  on  the  job 
to  which  he  has  been  promoted.  Those  categories  of  information  that  are 
predictive  of  performance  at  the  next  higher  level  could  be  identified.  A 
statement  as  to  the  success  of  the  selection  process  could  then  be  made. 
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If  management  is  satisfied  with  the  performance  of  people  being 
promoted  under  this  system  then  this  analysis  shows  the  kinds  of  infor- 
mation that  are  critical  in  making  these  decisions.  If  management  feels 
the  need  to  improve  the  system,  however,  what  then  might  be  done? 

One  possibility  is  to  take  the  current  forms  and  apply  an  explicit 
weighting  system  to  all  of  the  categories  of  information.  This  would 
ensure  greater  consistency  but  would  also  have  detrimental  effects.  It 
might  weaken  the  supervisor's  position  because  he  would  not  know  the 
kind  of  promotion  recommendation  that  he  had  given  his  supervisee.  If  a 
supervisor  is  to  encourage  effective  performance  on  the  part  of  his 
supervisees  he  must  have  the  means  for  rewarding  them  for  effective 
behaviors  and  a favorable  promotion  recommendation  is  one  way  of  doing 
this . 

Another  more  feasible  approach  is  to  identify  the  kinds  of  behaviors 
that  lead  to  effective  and  ineffective  job  performance  and  provide  the 
supervisor  with  a means  for  documenting  the  occurrence  of  these  behaviors 
on  the  part  of  his  supervisees.  Then,  when  an  administrative  decision, 
such  as  a promotion  recommendation  must  be  made,  the  supervisor  can  refer 
to  his  documentations.  Consistency  amongst  supervisors  can  be  achieved 
by  training  them  to  recognize  and  categorize  the  occurrence  of  these 
behaviors  so  that  they  can  then  be  documented  and  utilized  by  him  in 
making  administrative  decisions. 


■ 


Coding  of  Variables 
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Characteristics  Coding 

The  coding  routine  for  characteristics  is  the  same  as  that  given  in 
the  Employee  Appraisal  Guide  (p.  16),  that  is  1 to  4 representing  strong 
to  weak,  with  5 indicating  not  measured,  and  X signifying  inapplicable. 

(The  abstractness  characteristic  was  not  entered  due  to  its  infrequent 
usage.)  The  resulting  analysis  involved  the  eleven  characteristics  of: 

(1)  Drive;  (2)  Self-Confidence;  (3)  Objectiveness;  (4)  Responsiveness; 

(5)  Initiative;  (6)  Persistence;  (7)  Versatility;  (8)  Originality; 

(9)  Open-Mindedness;  (10)  Sociability;  (11)  Service  Concept  and;  (12)  Total 
Characteristics  (which  was  coded  A=4,  B=3,  C=2,  D=l). 

Qualifications  Coding 

In  coding  qualifications  an  attempt  was  made  to  be  as  inclusive  as 
possible  of  the  information  on  each  individual’s  form.  Thus  more  cate- 
gories than  necessary  were  included.  These  categories  were  coded  as 
follows : 

1.  Number  of  children  - ranges  upwards  from  0 for  no  children. 

2.  Availability  for  transfer  - 1 for  Yes,  0 for  No. 

3.  Need  for  transfer  - 1 for  Yes,  0 for  No. 

4.  Growth  potential  - 1 for  a favorable  statement,  0 for  none. 

5.  Remarks  - 1 for  remarks  favorable  to  promotion,  0 for  all  others. 

6.  Date  of  entry  on  present  grade  - high  number  represents  recent 
entry  into  grade. 

7.  Date  of  entry  on  present  assignment  - high  number  represents 
recent  entry  to  present  assignment. 


8. 
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Date  of  birth  - record  year  of  birth  - low  number  represents 
older  age. 

9.  Number  of  specialties  appraised  - high  number  indicates  many 
specialties . 

10.  Managerial  skills  - low  number  indicates  much  skill. 

11.  Professional  interest  - low  number  indicates  much  professional 
interest . 

12.  English  composition  - low  number  indicates  much  skill. 

13.  Preference  for  each  specialty  appraised  - low  number  indicates 
much  preference  for  that  specialty. 

14.  Number  of  years  experience  in  specialty  - high  number  indicates 
many  years  experience. 

15.  Breadth  of  experience  in  specialty  - number  of  different  regions 
worked  in,  in  this  specialty. 

16.  Total  qualifications  - coded  A=4,  B=3,  02,  D=l. 

Promotability  Coding 

1.  Total  characteristics  score  - coded  as  stated  above. 

2.  Total  qualifications  score  - coded  as  stated  above. 

3.  Overall  eligibility  ranking  - coded  as  A=4,  B=3,  02,  D=l. 


Glossary  of  Statistical  Terms 


Statistical  Summaries  of 
and  Qualifications 


Characteristics 

Analyses 
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A brief  glossary  of  some  statistical  measures  presented  in  the 
results  is  listed  below: 

(a)  Mean  - the  average  value  obtained  by  adding  up  all  the  scores 
for  a category  and  dividing  by  the  total  number  of  scores. 

(b)  Standard  Deviation  (S.D.)  - a measure  of  the  extent  to  which 
scores  vary  about  the  mean. 

(c)  N - the  number  of  individuals  involved  in  the  analysis. 

(d)  Correlation  - a measure  of  the  extent  to  which  two  categories 
contain  common  information.  This  measure  varies  from  4-1.00  for  a perfect 
positive  relationship  through  0.00  for  no  relationship  to  -1.00  for  a 
perfect  negative  relationship. 

Statistical  summaries  of  the  qualifications,  characteristics  and 
promotability  analyses  are  given  in  the  following  Exhibits.  The  r 
column  represents  the  correlation  of  each  of  the  characteristics  or 
qualifications  scores  with  the  total  characteristics  or  total  qualifi- 
cations scores  respectively.  The  negative  value  of  these  correlations 
merely  reflects  the  manner  of  coding.  Thus,  for  each  characteristic  a 
low  number  indicates  high  standing  whereas  on  the  total  characteristics 
a high  number  indicates  high  standing. 


Standard  Deviation  .57  .57  .62  .59  .61  .57  .58  .63  .63  .58  .51 

N=245 
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Exhibit  14 


Statistical  Summary  of  Timber  Management 
Eligibility  Analysis 


Intercorrelat ions 

1 

2 

r 

1. 

Total  Characteristics 

\ 

.14 

.88 

2. 

Total  Qualifications 

.44 

Mean 

3.24 

2.85 

2.86 

Standard  Deviation 

N=242 

.69 

.63 

.91 

Exhibit  15 

Statistical  Summary  of  Watershed 
Eligibility  Analysis 

Management 

Intercorre lat ions 

1 2 

r 

1. 

Total  Characteristics 

.01 

.72 

2. 

Total  Qualifications 

.59 

Mean  3 . 17 

Standard  Deviation  .50 

2.58 

.59 

2.69 

.75 

N=59 
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Exhibit  18 


Statistical  Summary  of  Lands  (Other) 
Eligibility  Analysis 


Intercorrelat ions 

1 

2 

r 

1. 

Total  Characteristics 

.13 

.86 

2. 

Total  Qualifications 

.56 

Mean 

3.23 

2.77 

2.88 

Standard  Deviation 

N=115 

.57 

.57 

.85 

Exhibit  19 

Statistical  Summary  of  Lands  (Recreation) 
Eligibility  Analysis 

Intercorrelat ions 

1 2 

r 

1.  Total 

Characteristics 

.02 

.82 

2.  Total 

Qualifications 

.46 

Mean 

3.19  2.81 

2.83 

Standard  Deviation  .59  .59  .86 

N=94 


Exhibit  20 


Statistical  Summary  of  Wildlife  Management 
Eligibility  Analysis 


Intercorrelations 

1 

2 

r 

1.  Total  Characteristics 

.11 

.70 

2.  Total  Qualifications 

.66 

Mean 

3.30 

2.81 

3.00 

Standard  Deviation 

N=43 

.47 

. 66 

.66 

Exhibit  21 

Statistical  Summary  of  Range 
Eligibility  Analysis 

Management 

Intercorrelations 

1 

2 

r 

1.  Total 

Characteristics 

.03 

.85 

2.  Total 

Qualifications 

.59 

Mean 

3.26 

2.98 

2.95 

Standard  Deviation  .58 

.71 

.84 

N=94 


Standard  Deviation  .60  .58  .62  .54  .60  .58  .62  .64  .64  .62  .54 

N=  169 
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Exhibit  24 


Statistical  Summary  of  Fire 
Eligibility  Analysis 

Control 

Inter corre lat ions 

1 

2 

r 

1.  Total 

Characteristics 

. 11 

.85 

2.  Total 

Qualifications 

.49 

Mean 

3.20 

2.76 

2.79 

Standard  Deviation  .63 

N=161 

. £'‘x 

.89 
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Statistical  Summary  of  Administrative 
Eligibility  Analysis 


Intercorrelations 

1 2 

1.  Total  Characteristics  .01 

2.  Total  Qualifications 


.80 

.45 


Mean 

Standard  Deviation 
N=267 


3.12 

.68 


2.48 

.57 


2.50 

.92 


Some  Multiple  Correlations  and  Raw  Score 
Weights  for  Selecting  the  Categories 
Which  Contribute  Most  to  Estimation 
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The  following  exhibits  present  the  squared  multiple  correlations 
and  raw  score  weights  for  each  step  in  selecting  the  categories  which 
contribute  most  to  estimation. 

The  b weights  are  the  different  weights  applied  to  the  several 
categories  of  information  in  order  to  combine  them  to  most  accurately 
predict  some  other  category  of  information.  The  squared  multiple 
correlation  (S.M. C.)  is  a measure  of  the  adequacy  with  which  this 
weighting  system  predicts  the  category  of  information.  It  varies  from 
+1.00  for  perfect  prediction  to  0.00  for  lack  of  any  predictability. 
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Squared  Multiple  Correlation  and  Ban  Score  Weights  for  lack  Step  in  Selecting 
Qualification  Categories  Which  Contribute  Most  to  Estimating  Total  Salifications 


Squared  Multiple 

Correlation  • 19  .28  .36  .41  .42  .43  .44  .44  .45 
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